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Abstract 

A video material selecting apparatus and a method for selecting a video material improve the operating 
efficiency of the selecting video material. The 

video data and associated data of each video materials which satisfy requirements inputted through an 
inputting means, out of the plurality of video 

materials from a storing means, and the reference image and associ ated information of each video 
material are displayed on a screen based on the 

video data and the associated data. 

Data supplied from the esp@cenet database - 12 

[0001] This invention relates to a video material selecting apparatus and method for selecting a video 
material. An embodiment of the invention is 

applicable to a device for creating an edit decision list. 

[0002] In the edit decision list creating device, the video of a video and audio material designated out 
of video and audio materials previously stored 

in a video server can be displayed on a monitor and sound can be outputted from a speaker. 

[0003] Consequently, in the edit decision list creating device, an operator can create an edi t decision 
list (EDL) for specifying the contents of edit. 
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such as in which order and how video and audio materials are connected together, based on these 
video and sound. 

[0004] In such edit decision list creating device, a keyword or the like 1 s inputted so that the text 
information of a video and audio material, such as 

a file name or a title, corresponding thereto can be displayed on a screen out of a plurality of video 
and audio materials stored in a video server, and 

an operator can select the video and audio materials to be employed for editing based on the text 
information displayed on the screen. 

[0005] However, in such edit decision list creating device, since only the text information of the video 
and audio material corresp ending to the 

keyword or the like inputted can be displayed on the screen as described above, the operator needs 
to select a desired video and audio material 

while reproducing the video and audio materials one by one and conforming the contents of them 
when a plurality of similar text information are 

present in a plurality of video and audio materials selected. Therefore, the edit decision list creating 
device has been disadvantageously low in its 

operating efficiency. 

[0006] An embodiment, as described herein, of the invention seeks to provide a video material 
selecting apparatus and a method for selecting video 

material in which the operating efficiency of the selecting work for video material can be improved. 

[0007] One aspect of the present invention provides a video material selecting have been achieved by 
the provision of a video material selecting 

apparatus which reads the video data and associated data of video materials which satisfy the 
inputted requirements out o f the plurality of video 

materials from storing means and displays the reference image and associated information of each 
video material on a screen based on the video 

data and the associated data. 

[0008] As a result, in the video material se lecting apparatus, the operator can grasp the contents of 
each relevant video material based on the 

reference image and associated infomiation of each of video materials which satisfy the requirements 
and which are displayed on the screen, and 

select a desired video material with ease. 

[0009] Another aspect of the present invention provides a method of selecting a video material to 
select a desired video material out of a plurality of 

video materials. In this method, the reference image an d associated information of each of the video 
materials which satisfy the prescribed 

requirements can be displayed on a screen out of the plurality of video materials. 

[0010] Consequently, according to the method for selecting a video material, t he operator can grasp 
the contents of each relevant video material 

based on the reference image and associated infomnation of each of video materials which satisfy the 
requirements and which are displayed on the 

screen and easily select a desired v ideo material. 

[001 1] A better understanding of the invention will become apparent from the following illustrative 
description when read in conjunction with the 
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accompanying drawings in which like parts are designated by like reference numerals o r characters. 
[0012] In the accompanying drawings: 

Fig. 1 is a block diagram showing the configuration of an edit decision list creating device to which an 
embodiment of the present invention is 
applied; 

Fig. 2 is a diagrammatic view e xplaining a video browser; 

Fig. 3 is a block diagram showing the configuration of a client computer; 

Figs. 4 to 6 are diagramrriatic views showing the configuration of a GUI screen according to a first 
embodiment; 

Figs. 7 to 10 are flow charts showing a list display window procedure according to the first 
embodiment; 

Figs. 11 to 13 are diagrammatic views showing the configuration of a GUI screen in a second 
embodiment; and 

Figs. 14 to 18 are flow charts showing a list display window p rocedure according to the second 
embodiment. 

[0013] Illustrative embodiments of this invention will be described with reference to the accompanying 
drawings: 

(1) First Embodiment 



(1-1) Constitution of edit decision list creating device according to first embodiment 

[0014] As shown in Fig. 1, reference numeral 1 generally designates an edit decision list creating 
device to which the present invention is applied 

and which comprises an encoder part 2, a video server 3, a data bas e server 4 and a client computer 
5 which are connected together through a 

local network 6. 

[0015] The encoder part 2 is composed of a personal computer on which an encode board is 
mounted, which sequentially fetches the data Dl of 

each video and audio material which is transferred from a material collecting spot through a 
transmission line, such as a telephone line and a 

satellite communication line, or which is reproduced and supplied by a video tape recorder from a data 
collecting tape, compresses and encode the 

data based on the dynamic image experts group phase 2 (MPEG 2) standard, and transmits encode 
data D2 thus obtained to the video server 3. 

[0016] Further, as illustrated in Fig. 2, the encoder part 2 extracts slit images 12 (12A, 12B, ...) in the 
vertical direction (shown in an arrow mark 

VY) while moving the slit images 12 sequentially toward one direction (a direction shown by an arrow 
mark VX) every n pieces of frame images 11 

(11 A, 1 1B, ...) of a series of successive frame image groups obtained based on the data Dl of the 
video and audio materials. Then, the encoder 
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part 2 forms the image data of static images (called browser images, hereinafter) 13A, 13B... which 
are formed by sequentially arranging these slit 

images 12 thus extracted in the other direction (in the direction opposite to that shown by the arrow 
mark VX) and transmits the image data thus 

formed to the video server 3 as browser image data D3. 

[0017] In this connection, in the browser images 13A, 13B, assuming that n = 1, the horizontal 
direction of the frame images has x dots and the 

width of the slit images is DELTA x dots, a browser mage for one frame which having x dots in the 
horizontal direction is formed by using f pieces 

of frame images 11 (11A, 11B...) which is obtained by the following equation (1). 

"(1)" f = X X DIVIDED DELTA x 



[0018] Thus formed browser image 13A, 13B ... for one frame can be recognized as the static image 
in which the contents of dynamic images 

based on the f pieces of frame images 11 (1 1 A, 1 1B ...) are compressed. 

[0019] On the other hand, the video server 3 is composed of an audio video (AV) server which has a 
recording and reproducing part with a disk array 

construction and which is capable of inputting and outputting data at high speed. The video server 3 
sequentially fetches the encode data D2 and 

the browser image data D3 supplied from the encoder part 2, makes files from them and stores the 
files in the recording and reproducing part every 

video and audio material. 

[0020] Further, at this time, the data (text data) D4 of text infomnation, such as the fife names or the 
titles, of each video and audio material 

inputted by an operator from a text data input part not shown is given to the data base server 4 
through the local network 6. Thus, the data base 

server 4 forms and stores the data base of the text data D4 of each video and audio material. 

[0021] Then, file data D5 composed of the encode data D2 and the browser image data D3 of each 
respective video and audio material which is 

stored in the video server 3, and the corresponding text data D4, which is stored in the data base 
server 4, can be read by using the client 

computer 5. 

[0022] In practice, when the operator inputs a keyword and the search instruction for the 
corresponding video and audio material at the time of a 

materia! selection mode, the client computer 5 controls to search the corresponding video and au dio 
material based on the data base, which is 

stored in the data base server 4, and read the text data D4 of the video and audio material. 

[0023] Further, the client computer 5 makes the video server 3 to read the file data D5 of the 
corresponding video and audio materials based on the 

search result. Then, based on the file data D5 and the text data D4 supplied from the data base server 
4, the client computer 5 displays the 

dynamic images of the browser images of the corresponding respect! ve video and audio materials 
(that is to say, the dynamic images obtained by 

sequentially displaying the browser images one frame by one frame with prescribed frame frequency, 
which are referred to as dynamic browser 
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images, hereinafter) or the dyn amic images of the video and audio materials, and the text information 
thereof on a display in a list form. 

[0024] As a result, the operator can select a desired video and audio material based on the dynamic 
browser images or the dynamic images of th e 

corresponding video and audio materials and the text information which are displayed on the display. 

[0025] Furthermore, when one video and audio material is selected out of the video and audio 
materials selected in the above -mentioned manner 

and a reproducing instruction therefor is inputted at the time of an edit decision list creating mode, the 
client computer 5 makes the video server 3 

read the file data D5 of the video and audio material and displays the dynamic image based on the f ile 
data D5 on the display. 

[0026] Consequently, the operator can designate an in point and an out point and register the desired 
part of the video and audio material as a clip 

while visually recognizing the dynamic image being displayed on the d isplay. Thus, the operator can 
register the desired parts of a plurality of video 

and audio materials as clips in the same manner. 

[0027] Then, the operator can create an edit decision list in which the contents of editing as to how the 
clips registered in such a manner are 

connected together are specified, by employing the client computer 5. The data D6 of the edit decision 
list (this is called edit decision list data, 

hereinafter) created in the above -mentioned manner is supplied to an e dit processing system from the 
client computer 5. In the edit processing 

system, an actual edit processing is carried out based on the edit decision list data D6. 



(1-2) Constitution of client computer 



[0028] Here, the client computer 5 com prises, as illustrated in Fig. 3, a central processing unit (CPU) 
20, a read only memory (ROM) 21, a random 

access memory (RAM) 22, a display processing part 23, a timer 24 and a plurality of interface circuits 
25 to 27, which are connected together 

through a CPU bus 28. A mouse 29 and a keyboard 30 are connected thereto respectively through the 
first and second interface circuits 25 and 26 

and a local network 6 is connected to the client computer 5 through the third interi'ace circuit 27. 

[0029] In this case, when an effective instruction for a prescribed processing is supplied through the 
first or second interface circuits 25 and 26 to 

the CPU 20 by operating the mouse 29 or the keyboard 30, the CPU 20 makes access to the video 
server 3 (see Fig. 1) and the data base sen/er 4 

(see Fig. 1) sequentially through the third interface circuit 27 and the local network 6 as desired based 
on a program stored in the ROM 21 and 

thereby, the file data D5 and its text data D4 of a required v ideo and audio material can be read out. 

[0030] Further, the CPU 20 reads out image data from the ROM 21 as required based on the program 
stored in the ROM 21 and supplies the read 

data to a display 31 through the display processing part 23 as a video signal SI. Thereby, an image is 
displayed on a graphical user interface (GUI) 
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screen described below and moreover, numerical characters, characters and the like inputted with a 
cursor moving in the screen in response to the 

mouse or the keyboard 30 are displayed on a display 31. 

[0031] Further, the CPU 20 supplies the file data D5 of each video and audio material fetched through 
the third interface circuit 27 to the display 

processing part 23. Then, the CPU 20 makes the display proce ssing part 23 decode the file data D5 if 
necessary, and then supplies the video 

signal SI thus obtained to the display 31. Thereby, the dynamic browser images or the dynamic 
images of the corresponding video and audio 

materials is displayed on the corresponding positions of the GUI screen. 



(1-3) GUI screen in client computer 



[0032] In practice, the CPU 20 displays a GUI screen 40 as illustrated in Fig. 4 on the display 31, 
based on the file data D5 of the corresponding 

video and audio materials read from the video server 3 in response to a keyword inputted by the 
operator and the text data D4 of the corresponding 

video and audio materials read from the data base server 4 in a material selection mode. 

[0033] As apparent from Fig. 4, the GUI screen 40 comprises a list display window 41 and a selected 
material display window 42. In the list display 

window 41 , the dynamic browser images or the dynamic images (called them reference images 43A to 
43F, hereinafter) of the corre sponding video 

and audio materials and text information 44A to 44F, such as the names of files, the number of frames 
and the names of materials, are displayed in 

a list form. 

[0034] Further, a scroll -up button 46A and a scroll -down button 46B are provided at the right end parts 
of the list display window 41 . These scroll -up 

button 46A and scroll -down button 46B are pressed down so as to scroll the list displayed in the list 
display window 41. 

[0035] Then, in the GUI screen 40, after the cursor is moved onto the reference image 43A to 43F of 
the desired video and audio material, the 

button of the mouse 29 is pressed down, the cursor 47 is moved to a desired position in the selected 
material display window 42 under this state, 

and then, the button of the mouse 29 is released (drag and drop), so that the video and audio material 
can be selected and the representative 

images 48A and 48B of the video and audio material selected at this time are displayed in positions 
dropped by the cursor in the selected material 

display window 42. 

[0036] At this time, in the list display window 41, a frame 49 is displayed as shown in Fig. 5 so as to 
surround a line in which the reference image 

43A to 43F of the selected video and a udio material and the text information 44A to 44F thereof are 
displayed. And. the inside background color of 

the frame 49 is changed to a prescribed color and the text information 44A to 44F is represented in a 
prescribed intensified color in the frame 49. 
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[0037] In this connection, such video and audio materials can be also selected from the lists displayed 
in the list display window 41 by 

double-clicking the lines in which the reference images 43A to 43F of the desired video and audio 
material and the text information 44A to 44F 

thereof are displayed. 

[0038] In addition, when the selection of the video and audio material is cancelled, a suitable line in 
the list displayed in the list display window 41 

may be clicked. As a result, the frame 49 displayed so as to surround the line is erased from the 
screen and the background color is returned to an 

ordinary color and the text information is also represented in an ordinary color Besides, the 
representative images 48A and 48B of the video and 

audio material displayed at that time in the selected material display window 42 are also erased from 
the screen. 

[0039] Thus, the operator can sequentially select the desired video and audio materials from the list 
displayed in the list display window 41 by such 

an operation. After the operator selects all the desired video and audio materials, he/she double -clicks 
the representative images 48A and 488 of 

the desired video and audio material displayed in the selected materia I display window 42. so that an 
edit decision list creating mode is selected to 

display a clip forming window 50 and a time line window 51 as illustrated in Fig. 6 in place of the list 
display window 41 . 

[0040] In this case, the clip forming wind ow 50 is a window for designating desired parts of the video 
and audio material as clips. As stated above, 

the desired representative images 48A and 488 out of a plurality of video and audio materials of which 
the representative images 48A and 488 are 

displayed in the selected material display window 42 are double -clicked, so that the representative 
images 48A and 488 of the video and audio 

material can be displayed in a image display part 52. 

[0041] Further, in the clip forming window 50, operating buttons 53 displayed below the image display 
part 52 are clicked, so that the representative 

images 48A and 488 of the video and audio material are displayed in the image display part 52. In this 
case, the video server 3 (see Fig. 1) can 

perform an operation corresponding to the operating buttons 53 relative to the above described video 
and audio material of which the representative 

images 48A and 488 are displayed in the display part 52, and video images being reproduced at this 
time are displayed in the image display part 

52. 

[0042] Then, the operator clicks an in -point button 54A and an out -point button 55A while visually 
recognizing the images displayed in the image 

display part 52 so as to designate an in -point and an out-point. The frame image and the time code of 
the designated in -point are respectively 

displayed in an in-point image display part 548 and an in -point time code display part 54C, and the 
frame image and the time code of the 

designated out-point are respectively displayed in an out -point image display part 558 and an out - 
point time code display part 55C. In addition to 

this the length from the in -point to the out-point (in other words, the length of a clip) is displayed in a 
duration display part 56. 
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[0043] Further, the operator designates the in -point and the out-point in this way, and then clicks an 
add button 57 so as to register images from 

the in-point to the out -point of the video and audio material as a clip separately from th e original video 
and audio material. The frame image of the 

in-point of the clip registered in such a manner (referred to as an in -point image, hereinafter) is 
displayed in the selected material display window 42 

separately from the representative images 48A and 48B of the original video and audio material. 

[0044] Furthennore, the operator designates the in -point and the out -point as mentioned above, and 
then, clicks an apply button 58 so as to 

register a part from the in -point to the out -point of the video and audio material as a clip in place of the 
original video and audio material. The in -point 

image of the clip registered in such a manner is displayed in the selected material display window 42 
instead of the representative images 4 8A and 

48B of the original video and audio material. 

[0045] On the other hand, in the GUI screen 40, after the clips of a plurality of video and audio 
materials are registered in this manner, an edit 

decision list can be created by employing the time line window 51 in accordance with a method 
mentioned below. 

[0046] At first, the cursor 47 is moved to the in -point image of a desired clip in the selected material 
display window 42, the button of the mouse 29 

is pressed down, the cursor 47 is moved, under this state, to a desired position on a video track 61 E 
of a plurality of tracks 61 A to 61 1 provided 

along a time scale 60 serving as an index in the time line window 51 and then, the button of the 
mouse 29 is released. 

[0047] Consequently, in the video track 61 E, a bar 62A of a prescribed color having the length 
corresponding to the length of a rnaterial of the clip 

designated as described above is displayed with the position of the then cursor 47 as the head. 
Further, at this time, when the original video and 

audio material being the origin of the clip has sound, a bar 62B with the same length as that of the bar 
62A displayed on the video track 61 E is also 

displayed at the same position on the time scale 60 on an au dio track 61 F. 

[0048] Then, the operator repeatedly carries out the operations as mentioned above, so that the bars 
62A and 628 are sequentially displayed on 

the video track 61 E and the audio track 61 F so as to be continued on the time scale 60 f rom a first 
time code ( "00.00.00:00") to a desired time 

code (that is, for desired duration of time) on the time scale 60. 

[0049] Here, the fact that the bars 62A and 628 are displayed on the video track 61 E and the audio 
track 61 F in the time line window 51 means 

that the images and sound of the clip corresponding to the bars 62A and 628 are displayed and 
outputted at the time represented on the time 

scale 60 at the time of outputting the edited video images and sound. Thus, the edit dec ision list that 
sequentially specifies clip images or sound to 

be displayed as edited images or to be outputted as edited sound can be created by the above - 
mentioned operations. 



NOKIA 



COPY FROM 
ESPACENET 



9(21) ^' ^ 



NVO/IPR 

Leena Ranta 14.08.2001 



[0050] Now, in the case of creating the edit decision list in such a way, when it is desired to apply a 
special effect processing to the images at the 

time of switching a first clip image to a second image, a special effect selecting button 63M is clicked 
from a plurality of buttons 63A to 63T for 

selecting various kinds of processes which are provided on the upper stage of the time line window 
51. 

[0051] As a result, a prescribed window (not shown) on which a plurality of icons (referred to as effect 
icons, hereinafter) indicating the contents of 

various sorts of executable special effect processes are displayed can be opened on the GUI screen 
40. Then, the icon corresponding to a desired 

special effect process is displayed so as to stick to an effect track 61 D by a drag and drop operation 
so that the icon is located at the same 

position on the time scale 60 as the border on the bar 62A between the first and second clips 
displayed on the video track 61 E of the time line 

window 51. 

[0052] Thus, an instruction that the special effect process corresponding to the effect icon stuck to the 
effect track as mentioned above in the 

joined part of the video images of the first and second clips is to be carried out can be inputted. 

[0053] As stated above, in the edit decision list creating d evice 1, the operator selects desired video 
and audio materials out of a plurality of video 

and audio materials stored in the video server 3 by using the client computer 3 and designates an in - 
point and out-point of them, so that the edit 

decision list can be created based on the clips. 



(1-4) Procedure of CPU in list display window 



[0054] The CPU 20 of the client computer 3 performs the various kinds of processes as mentioned 
above in the list display window 51 on the GUI 

screen 40 in accordance with a list display window procedure RT1 shown in Figs. 7 to 10. 

[0055] In practice, when the operator selects the material selection mode and inputs a keyword and 
then, inputs the search instruction of the video 

and audio materials corresponding thereto, the CPU 20 starts the list display window procedure RT1 
at step SPO. At following step SP1 , the CPU 

20 makes access to the data base server 4 (see Fig. 1) to read the text data D4 of a video and audio 
material corresponding ther eto. Further, the 

CPU 20 also makes access to the video server 3 (see Fig. 1) to read the browser image data D3 or 
the encode data D2 of the video and audio 

material for one frame. 

[0056] Then, the CPU 20 advances to step SP2 to prepare contr ol buffers for each line in the F^M 22 
for controlling as to which line (also including 

lines not displayed on the screen) of the list corresponds to the video and audio material. After that, 
the CPU moves to step SP3 to store the text 

data D4 acquired at step SP2 in corresponding control buffer prepared at step SP1. 
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[0057] Subsequently, the CPU 20 advances to step SP4 to decide whether or not the text data D4 of 
all the corresponding video and audio 

materials is obtained from the data bas e server 4. When a negative result is obtained, the CPU 20 
returns to step SP1 to repeat the loop of steps 

SP1-SP2-SP3-SP4-SP1 until an affimnative result is obtained at step SP4. 

[0058] Then, when the affirmative result is obtained at step SP4, the CPU 20 advances to step SP5 to 
coordinate the each line of the list to the 

address of each control buffer. After that, the CPU 20 advances to step SP6 to display the list (a part 
thereof) as shown in Fig. 4 in the list display 

window 41 of the GUI screen 40. 

[0059] Subsequently, the CPU 20 proceeds to step SP7 to make access to the video server 3 (see 
Fig. 1 ) in order to open the file of each video 

and audio material being in the list displayed in the list display window 41 at this tim e. Further, the 
CPU 20 advances to step SP8 to set the timer 

24 (see Fig. 3) to a frame cycle for displaying the reference images 43A to 43F composed of the 
dynamic browser images or the dynamic images 

to be displayed in the list display window 41 of the GUI screen 40. 

[0060] Then, the CPU 20 advances to step SP9 and then, sequentially and repeatedly decides at 
steps SP9 to SP1 2 whether or not the timer 24 

calls, whether or not the scroll -up button 46A (see Fig. 4) or the scroll -down button 46B (see Fig. 4) is 
pressed down, whether or not the video and 

audio material is selected, and whether or not the edit decision list creating mode is selected (whether 
or not the representative images 48A and 

48B displayed on the selected materia I display window 42 are double clicked), respectively. 

[0061] When the affirmative result is obtained at step SP9, the CPU 20 advances to step SP13 (see 
Fig. 8) to store a line number (called a, 

hereinafter) indicating which line from the first o f the list corresponds to the head line of the list 
displayed in the list display window 41 . After that, 

the CPU 20 advances to step SP14 to read the browser image data D3 or the encode data D2 of the 
video and audio material for one frame to be 

displayed on the line of the stored value "a" from the video server 3. 

[0062] Next, the CPU 20 moves to step SP15 to decide whether or not the reference images 43A to 
43F are already displayed up to last frame on 

the a-th line of the list. When an affirmative result is obtained, the CPU 20 advances to step SP 16 to 
make access to the video sen/er 3 and closes 

the file of the video and audio material on the a -th line. At next step SP17, the CPU 20 makes access 
again to the video server 3 to reope n the file 

of the video and audio material on the a -th line and returns to step SP14. 

[0063] On the contrary, when an negative result is obtained at step SP15, the CPU 20 moves to step 
SP18 to display the reference images 43A to 

43B based on the browser image data D3 or the encode data D2 for one frame, which is read from the 
video server 3 at step SP14, at the 

corresponding positions on the a -th line of the list. Then, the CPU 20 advances to step SP19 to decide 
whether or not the a-th line is a line in which 

the corresponding video and audio material is selected. 
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[0064] When an affirmative answer is obtained at step SP19, the CPU 20 moves to step SP20 to 
display the frame 49 (see Fig. 5) so as to 

surround the a-th line of the list and changes the inside background color to a predetermined color 
and displays the corresponding text information 

44A to 44F with an intensified color, and then, moves to step SP23. 

[0065] On the contrary, when a negative result is obtained at step SP19, the CPU 20 advances to step 
SP21 to decide whether or not the a -th line 

is a line in which the selection of the corresponding video and audio material has been cancelled. 

[0066] Then, when an affimiative answer is obtained at step S P21 , the CPU 20 moves to step SP 22 
to erase the frame 49 being displayed so as to 

surround the a-th line and to return the background color to an original color, and then, proceeds to 
step SP23. 

[0067] On the contrary, when a negative answer is obtained at step SP21 , the CPU 20 moves to step 
SP23 to display the text infonnation 44A to 

44F with an ordinary color on an n -th line of the list, and then, advances to step SP24 to decide 
whether or not the a-th line is the last line of the list 

to be displayed on the screen. 

[0068] Then, when a negative result is obtained at step SP24, the CPU 20 adds one to the stored line 
number a, and then, returns to step SP14 to 

repeat the loop of step SP14 to steps SP24 -SP14 until the affirmative result is obtained at step SP24. 

[0069] Thus, the CPU 20 displays the reference images 43A to 43F and the text infomiation 44A to 
44F of the video and audio material 

corresponding to the last line of the list displayed on the screen. Then, when t he affirmative result is 
obtained at step SP24, the CPU 20 returns to 

step SP9 to repeat the loop of step SP9 to steps SP12 -SP9 until an affirmative result is obtained at 
any of step SP9 to step SP12. 

[0070] On the other hand, when the affirmativ e result is obtained at step SP10, the CPU 20 advances 
to step SP26 (see Fig. 9) to store a value "0", 

and then moves to step SP27 to decide whether or not a value (called b, hereinafter) stored at that 
time coincides to the total number of lines (also 

including parts which are not displayed on the screen). 

[0071] When a negative result Is obtained at step SP27, the CPU 20 moves to step SP28 to decide 
whether or not the b-th line of the list is a line 

which is not displayed on the screen by a scrolling operation. When a negative result is obtained, the 
CPU 20 moves to step SP29 to add one to 

the stored value b, and then, returns to step SP27. 

[0072] Then, the CPU 20 repeats the loop of steps SP27 -SP28-SP29-SP27 to detect a line which is 
not displayed on the screen by scrolling the 

list. Thus, when an affinmative result is obtained at step SP 28, the CPU 20 moves to step SP30 to 
decide whether or not the b-th line is a line 

which has not been displayed. 

[0073] Consequently, when an affirmative result is obtained at step SP30, the CPU 20 advances to 
step SP29. On the contrary, when a negative 
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result is obtained, the CPU 20 moves to step SP31 to erase the reference images 43A to 43F for one 
frame and the text Informat ion 44A to 44F on 

the b-th line being displayed on the screen at that time from the screen, and then, advances to step 
SP32 to make access to the video server 3 to 

close the file of the video and audio material on the b -th line. After that, the CPU 20 moves to step 
SP29. 



[0074] In such a manner, the CPU 20 sequentially decides whether or not each of all the lines of the 
list is a line which will not be displayed by a 

scrolling operation regardless of lines which are displayed on the screen or lines which are not 
displayed on the screen, at step SP27 to step 

SP32. As for the lines which will not be displayed on the screen, the CPU 20 erases from the screen 
the reference images 43A to 43F for one 

frame and the text information 44A to 44F thereof which are displayed on the screen at that time. 

[0075] When an affirmative result is obtained at step SP27 because of completing the above 
described decision for all the lines of the list, the CPU 

20 advances to step SP33 to make acce ss to the video sen/er 3 so as to open the file of the video and 
audio material on a c -th line of the list to be 

newly displayed on the screen, and then, retums to step SP9. After that, the CPU 20 repeats the loop 
of step SP9 to steps SP12 to SP9 unti I an 

affirmative result is obtained at any of step SP9 to step SP12. 

[0076] Note that, the above mentioned processes are repeatedly carried out for the number of lines of 
the list to be newly displayed on the screen. 

As for the lines to be newly displayed on the screen, the timer 24 (see Fig. 3) as described above calls 
to sequentially display the reference 

images 43A to 43F for one frame and the text information 44A to 44F on the screen. 

[0077] On the other hand, when the affirmativ e result is obtained at step SP1 1, the CPU 20 advances 
to step SP34 (see Fig. 10) to make access 

to the video server 3 in order to make it display the representative images 48A and 48B of the video 
and audio material on a selected line in the 

selected material display window 42. 

[0078] Then, the CPU 20 proceeds to step SP35 to display the frame 49 (see Fig. 5)so as to surround 
the selected line and moves to subsequent 

step SP36 to change the inside background color of the frame 49 to an in tensified color. 

[0079] Further, the CPU 20 displays the text information 44A to 44F on the selected line with the 
intensified color at next step SP37 and then, 

returns to step SP9. After this, the CPU 20 repeats the loop of step SP9 to steps SP1 2-SP9 until an 
affirmative result is obtained at any of step 

SP9tostepSP12. 

[0080] On the other hand, when the affirmative result is obtained at step SP12, the CPU 20 advances 
to step SP38 to reset the timer 24 (see Fig. 

3). At next step SP39, the CPU 20 makes access to the video server 3 to close the file of the video 
and audio material on each line of the list which 

is displayed on the screen at that time. 
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[0081] Then, the CPU 20 closes the list display window 41 at next step SP 40, and then, advances to 
step SP41 to finish the list display window 
procedure RT1. 



(1-5) Operation and effects of ennbodiment 



[0082] According to the above mentioned constitution, in the client computer 5 of the edit decision list 
creating device 1, the reference images 43A 

to 43F and the text information 44A to 44F of the corresponding video and audio materials are 
displayed during the material selection mode in the 

list form in the list display window 41 of the GUI screen 40. Thu s, the operator can select the desired 
video and audio materials based on the 

reference images 43A to 43F and the text information 44A to 44F being displayed on the screen. 

[0083] Therefore, according to the edit decision list creating device 1, for example, even when there 
are a plurality of video and audio materials 

having the similar text information 44A to 44F, desired video and audio materials can be selected with 
ease based on the reference images 43A to 

43F corresponding thereto. 

[0084] Further, in the edit decision list creating device 1, since the dynamic browser images or the 
dynamic images are displayed on the GUI 

screen 40 as the reference images 43A to 43F of the video and audio materials, the operator can 
easily understand the contents of the video and 

audio materials, and therefore, desired video and audio materials can be more readily selected. 

[0085] According to the above mentioned construction, since the reference images 43A to 43F and the 
text information 44A to 44F of the 

corresponding video and audio materials are displayed in the list display window 41 of the GUI screen 
40, and the desired video and audio materials 

can be selected based on these reference images 43A to 43F and text informatio n 44A to 44F being 
displayed on the screen, the operator can 

easily select the desired video and audio materials. Therefore, the edit decision list creating device 
can be realized by which the operating 

efficiency of a selection work for video and audio materials can be remarkably improved. 



(2) Second Embodiment 



(2-1) Constitution of edit decision list creating device and GUI screen according to second 
embodiment 



[0086] In Fig. 1 , an edit decision list creating device 70 accordin g to a second embodiment is 
constructed in a manner similar to that of the edit 

decision list creating device 1 according to the first embodiment except a list form displayed on a list 
display window of a below described GUI 
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screen which is displayed, upon material selection mode, on the display 31 (see Fig. 3) of a client 
computer 71 and the processes of the CPU 20 
(see Fig. 3) in the list display window. 

[0087] In this case, in the edit decision list creating device 70, a GUI screen 72 a s illustrated in Fig. 11 
in which the same reference numerals are 

applied to parts corresponding to Fig. 4 is displayed on the display 31 of the client computer 71 at the 
time of the material selection mode. 

[0088] In practice, on the GUI screen 73, the static browser images or the static images (referred to 
reference images 75A to 75G, hereinafter) of 

video and audio materials corresponding to a keyword which is previously inputted by an operator and 
text information 44A to 44G corresponding 

thereto are displayed in a list display window 74 in a list form. 

[0089] In the GUI screen 73, when a cursor 47 is movfed onto the reference image 75A to 75G on any 
line by operating a mouse, the reference 

image 75A to 75G is displayed in enia rged forms as the dynamic browser image or the dynamic 
image, as shown in Fig. 12. Therefore, the 

operator can sequentially visually confirm the dynamic browser images or the dynamic images of the 
video and audio materials displayed in the list 

form. 

[0090] In the GUI screen 73, desired video and audio materials can be selected in the same manner 
as that of the first embodiment. At this time, in 

the list display window 74 of the GUI screen 73, a frame 76 is displayed so as to surround the line of 
the list corresponding to the selected video 

and audio material, as illustrated in Fig. 13 and moreover, changes the inside background color of the 
frame to an emphasized color and displays 

the text information 44A to 44G on the line in an emphasized color. 

[0091] Note that, when the selection of the video and audio material is cancelled, the line of the 
corresponding list being displayed on the list 

display window 74 may be clicked. As a result, the frame 76, which is being displa yed so as to 
surround the line, is erased from the screen, the 

background color returns to an ordinary color and the text information is displayed in an ordinary color. 
Further, at this time, the representative 

images 48A and 48B of the video and a udio material being displayed in a selected material display 
window 42 are also erased from the screen. 



(2-2) Procedure of CPU in list display window 



[0092] The CPU 20 of the client computer 71 carries out various kinds of processes described above 
in the list display window 74 of the GUI screen 

73 in accordance with a list display window procedure RT2 shown in Figs. 14 to 18. 

[0093] In practice, when the material selection mode is selected and the keyword is inputted by the 
operator, and then, a search instruction for the 

video and audio materials corresponding thereto is inputted, the CPU 20 starts the list display window 
procedure RT2 at step SP40- The CPU 20 
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sequentially performs the processes from next step SP41 to step SP 47 in a similar manner to that of 
step SP1 to step SP7 of the list display 

window procedure RT1 in the first embodiment. 

[0094] Then, the CPU 20 advances to step SP49 to sequentially and repeatedly decide at step SP49 
to step SP52 respectively whether or not the 

cursor 47 is moved, whether or not the timer 24 (see Fig. 3) calls, whether or not a scroll -up button 
46A or a scroll -down button 46B is pressed 

down, whether or not the video and audio materials are selected and whether or not an edit decision 
list creating mode is selected. 

[0095] When an affirmative result is obtained at step SP48. the CPU 20 advances to step SP53 (see 
Fig. 15) to decide whether or not the cursor 47 

is moved onto any of the reference images 75A to 75G o f the list being displayed in the list display 
window 74. When a negative result is obtained, 

the CPU 20 returns to step SP49. On the contrary, when an affirmative result is obtained, the CPU 20 
advances to step SP54 to decide whether or 

not there exists a line having the reference image 75A to 75G displayed in enlarged forms at that time. 

[0096] Then, when a negative result is obtained at step SP54, the CPU 20 moves to step SP58. On 
the contrary, when an affirmative result is 

obtained, the CPU 20 advances to step SP55 to reset the timer 24 (see Fig. 3), and then, advances to 
step SP56. At step 56, the CPU 20 makes 

access to the video server 3 (see Fig. 1) to read the browser image data D3 or the encode data D2 of 
the video and audio materials on a d-th line for 

one frame and to display browser images or frame images based on the browser image data D3 or 
the encode data D2 in ordinary sizes as the 

reference image 75A to 75G at a predetermined position in the corresponding line of the list. 

[0097] Next, the CPU 20 advances to step SP57 to make access to the video server 3 in order to 
close the file of the video and audio material on 

the line in which the reference image 75A to 75G are displayed in enlarged forms, and then , moves to 
step SP58 to open the file of the video and 

audio material on a line in which the cursor 47 newly exists. 

[0098] Then, the CPU 20 sets, at the following step SP59, the timer 24 to the value of the frame cycle 
of the reference image 75A to 75G (dynamic 

browser image or dynamic image) to be displayed in enlarged fonns, and then returns to step SP49. 
After that, the CPU 20 repeats the loop of 

steps SP49 to SP52-SP49 until an affirmative result is obtained at any of step 49 to step SP52. 

[0099] On the other hand, when the affirmative result is obtained at step SP49, the CPU 20 advances 
to step SP60 (see Fig. 16) to make access 

to the video server 3 in order to read the browser image data D3 or the encode data D2 for one fra me 
of the video and audio material corresponding 

to the line of the list displayed in the list display window 71 in which the reference image 75A to 75G is 
displayed in enlarged forms. At next step 

SP61. the CPU 20 displays the browser image or the frame image for one frame based on the read 
browser image data D3 or encode data D2 in 

enlarged forms as the reference image 75A to 75G at prescribed position in a corresponding line of 
the list display window 71 . 



IMOKIA 



COPY FROM 
ESPACENET 



16(21) 



NVO/IPR 

Leena Ranta 14.08.2001 



[0100] Then, the CPU 20 proceed s to step SP62 to decide whether or not the line on which the 
reference image 75A to 75G is displayed in 

enlarged forms is a line in which the corresponding video and audio material has been already 
selected. 

[0101] When a negative result is obta ined at step SP63, the CPU 20 moves to step SP64 to display 
the corresponding text information 44A to 44G 

in the line in an ordinary color, and then, returns to step SP49. On the contrary, when an affirmative 
result is obtained, the CPU 20 advances to 

step SP64 to represent the corresponding text information 44A to 44G in the line in an emphasized 
color, and then, returns to step SP49. 

Thereafter, the CPU 20 repeats the loop of steps SP49 to SP52 -SP49 until an affirmative result is 
obtained at any of step SP49 to step SP52. 

[0102] On the other hand, when the affirmative result is obtained at step SP50, the CPU 20 advances 
to step SP65 (see Fig. 17) to store a value 

"0", and then moves to step SP66. At step SP66, the CPU 20 decides wheth er or not the value 
(referred to as f, hereinafter) stored at that time 

coincides to the total number of lines (also including lines which are not displayed on the screen). 

[0103] When an affirmative result is obtained at step SP66, the CPU 20 mo ves to step SP67 to decide 
whether or not a f -th line of the list is a line 

which is not displayed by a scrolling operation. When a negative result is obtained, the CPU 20 moves 
to step SP68 to add one to the stored value 

f, and then returns to ste p SP66. 

[0104] Then, the CPU 20 repeats the loop of steps SP66 -SP67-SP68-SP66 so that it detects a line 
which is not displayed on the screen by 

scrolling the list. Thus, when an affirmative result is obtained at step SP67, the CPUU 20 advances to 
step SP69 to decide whether or not the f -th 

line is a line which has not been displayed. 

[0105] When an affirmative result is obtained at step SP69, the CPU 20 moves to step SP68. On the 
contrary, when a negative result is obtained, 

the CPU 20 moves to step SP70 to erase the reference image 75A to 75G and the text information 
44A to 44G on the f -th line, which are displayed 

on the screen, from the screen, and then moves to step SP68. 

[0106] As described above, the CPU 20 sequentiall y decides whether or not each of all the lines of the 
list is a line which will be not displayed on 

the screen by a scrolling operation, regardless of the lines displayed or not displayed on the screen, at 
step SP66 to step SP70. As for the lines 

which will not be displayed on the screen, the reference image 75A to 75F for one frame and the text 
information 44A to 44F which are displayed 

on the screen at that time are erased from the screen. 

[0107] Then, when the CPU 20 finishes the above mentioned decision to all the lines of the list 
because an affirmative result is obtained at step 

SP66, it advances to step SP71 to make access to the video server 3. Thereby, the CPU 20 reads the 
browser image data D3 or the encode data 

D2 for one frame of the video and audio material on a g -th line of the list to be newly displayed on the 
screen. Then, the CPU 20 ordinarily display 



NOKIA 



COPY FROM 
ESPACENET 



17(21) 



NVO/IPR 

Leena Ranta 14.08.2001 



the reference image 75A to 75G composed of the static browser image or static image for one frame 
based on the browser image data D3 of the 

encode data D2 and the text information 44A to 44G thereof on the g -th line of the list. 

[0108] Next, the CPU 20 returns to step SP49 and repeats the loop of steps SP 49 to SP50 -SP51- 
SP52 until an affirmative result is obtained at 
any of step 49 to step SP52. 

[0109] On the other hand, when the affirmative result is obtained at step SP52, the CPU 20 advances 
to step SP72 (see Fig. 18). After the CPU 20 

performs the processes of step SP72 to step SP75 in the same manner as that of step SP34 to step 
SP37 in the list display window procedure 

RT1 of the first embodiment, it returns to step SP49. Then, the CPU 20 repeats the loop of steps 
SP49-SP50-SP51-SP52 until an affimnative result 

is obtained at any of step SP49 to step SP52. 

[0110] Further, when the affirmative result is obtained at step SP52, the CPU 20 advances to step 
SP76 to reset the timer 24, and then, moves to 

step SP77 to close the file of the video and audio material in which the re ference image 75A to 75G is 
displayed in enlarged forms in the list display 

window 74. 

[01 1 1] Then, the CPU 20 proceeds to step SP78 to close the list display window 74, and then, moves 
to step SP79 to complete the list display 
window procedure RT2. 



(2-3) Operation and effects of embodiment 



[0112] According to the construction mentioned above, in the edit decision list creating device 70 of 
the second embodiment, the reference images 

75A to 75G composed of the static browser i mages or the static images for one frame and the text 
information 44A to 44G of the corresponding 

video and audio materials are displayed, upon material selection mode, in a list form in the list display 
window 74 of the GUI screen 73 displayed 

on the display 31 of the client computer 71. 

[01 13] When the mouse 47 is moved onto any of the reference images 75A to 75G being displayed in 
the list display window 74, the reference 

image 75A to 75G of the corresponding video and audio material is displayed in enlarged forms as the 
dynamic browser image or the dynamic 

image. 

[0114] Therefore, in the edit decision list creating device 70, even when there are a plurality of video 
and audio materials having similar text 

information 44A to 44G, the desired video and audio materials can be selected with ease based on 
the corresponding reference images 75A to 

75G, like the edit decision list creating device 1 of the first embodiment. 

[0115] Further, in the edit decision list creati ng device 70, since the usually static browser images or 
the static images are displayed on the GUI 



IMOKIA 



COPY FROM 
ESPACENET 



18 (21) 



NVO/IPR 

Leena Ranta 14.08.2001 



screen 73 as the reference images 75A to 75G of the respective video and audio materials, and 
further, the cursor 47 is moved onto the desired 

reference Image 75A to 75G so as to display the reference image 75A to 75G in enlarged forms as the 
dynamic browser image or the dynamic 

image, the operator can readily grasp the contents of the video image of the desired video and audio 
material. Thus, the selecting work of the video 

and audio materials can be more easily performed. 

[01 16] With the construction mentioned above, the reference images 75A to 75G composed of the 
static browser images or the static images for 

one frame and the text information 44A to 44G of the corresponding video and audio materials are 
displayed in a list form in the list display window 

74 of the GUI screen 73. Further, when the mouse 47 is moved onto any of the reference images 75A 
to 75G, the reference image 75A to 75G is 

displayed in enlarged forms as the dynamic browser image or the dynamic Image. Consequently, the 
selecting work of the video and audio 

materials can be more readily performed. Thus, an edit decision list creating device by which the 
operating efficiency of the selecting work for the 

video and audio materials can be extremely improved can be realized. 



(3) Other Embodiments 



[01 17] In the above described first and second embodiments, the text Information, such as the fil e 
names, the titles, the number of frames, etc., of 

the video and audio materials is stored in the data base server 4 as the associated information of the 
video and audio materials to be stored in the 

data base server 4. However, the present invent ion Is not limited thereto and other various kinds of 
associated information by which the respective 

video and audio materials can be Identified can be stored in the data base server 4. 

[01 18] Further, according to the above first and second embo diments, the present invention Is applied 
to the edit decision list creating device 

capable of selecting the desired video and audio materials out of a plurality of video and audio 
materials. However, the present Invention Is not 

limited thereto. I n short, the present invention can be broadly applied to other various types of video 
material selecting apparatuses capable of 

selecting desired video and audio materials out of a plurality of video and audio materials. 

[0119] Further, according to the above first and second embodiments, the storing means for storing 
the video data and associated data of a plurality 

of video and audio materials comprises the video sen/er 3 having the recording and reproducing part 
with a disk array structure and the data base 

server 4. However, the present Invention Is not limited thereto and any different kinds of other 
structures can be widely employed. 

[0120] Still further, according to the above first and second embodiments, a key word is inputte d as a 
requirement to make the client computer 5 or 

71 search the corresponding video and audio materials. However, the present invention is not limited 
thereto and the corresponding video and audio 

materials can be searched based on other various requirements. 
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[0121] Still further, according to the above first and second embodiments, the client computer 5 or 71 
is constructed as shown in Fig. 3 as a screen 

display means for reading the browser image data D3 or the encode data D2, and the text data D4 of 
the corresponding video and audio materials 

out of a plurality of video and audio materials from the video server 3 and the data base server 4, and 
displaying on the screen the reference images 

43A to 43F or 75A to 75G and the text information 44A to 44G of the video and audio materials based 
on the browser image data D3 or the encode 

data D2. However, the present invention is not limited thereto and other types of structures can be 
widely employed. 

[0122] In addition, according to the above described first and second embodiments, the vertical slit 
images 12 are sequentially moved toward one 

direction (the direction shown by an arrow mark VX in Fig. 2) and extracted from a series of frame 
images which are obtained based on the data D1 

of the video and audio materials and the extracted images are arranged sequentially in the other 
direction to form the browser images. However, the 

present invention is not limited thereto and directions other than the above describe d directions can be 
broadly employed as a direction of the slit 

images, a direction for extracting them and a direction for arranging them. 

[0123] Additionally, according to the above first embodiment, the dynamic browser images or the 
dynamic images are simply displayed as the 

reference images 43A to 43F of the corresponding video and audio materials. However, the present 
invention is not limited thereto and the reference 

image 43A to 43F corresponding to the designated video and audio ma terial can be displayed in 
enlarged forms as in the second embodiment. 

[0124] Furthermore, according to the above described second embodiment, the reference image 75A 
to 75G designated from the reference images 

75A to 75G being displayed in the I ist display window 74 of the GUI screen 73 are displayed in 
enlarged forms. However, the present invention is 

not limited thereto, and the designated reference images 75A to 75G can be simply displayed in 
ordinary sizes as the dynamic browser images or 

the dynamic images. 

[0125] As mentioned above, the video data and associated data of video materials which satisfy the 
requirements inputted through an inputting 

means are read from a plurality of video materials of a storing means, and refe rence image and 
associated information of each video material are 

displayed on a screen based on the video data and the associated data. Therefore, the operator can 
grasp the contents of the corresponding video 

materials based on the reference imag es and associated information of the respective video materials 
which satisfy the requirements and which is 

displayed on the screen and can readily select the desired video materials. In such a way, the 
operating efficiency of the selecting work for th e 

video materials can be remarkably improved. 

[0126] Further, a first step of searching each video material which satisfies predetermined 
requirements out of the plurality of video materials and a 
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second step of displaying the reference image and associated Information of each of the video 
materials based on the video data and associated 

data of corresponding video materials. Therefore, the operator can grasp the contents of the 
corresponding video materials based on the reference 

images and associated information of the video materials which satisfy the requirements and which is 
displayed on the screen, and can readily 

select the desired video materials. Accordingly, the operating efficiency of the selecting work for the 
video materials can be remarkably improved. 

[0127] While there has been described in connection with the preferred embodiments of the invention 
it will be obvious to those skilled in the art 

that various changes and modifications may be made, therefore, as fall within the spirit and scope of 
the invention. 

1. A video material selecting apparatus capable of selecting a desired video material out of a plurality of 
video materials, comprising: 

storing means for storing video data and associated data of said plurality of video materials; 
input means for inputting prescribed requirements; and 

display means for reading said video data and said associated data of each video material which 
satisfies said prescribed requirements, which are 

inputted through said input means, out of said plurality of video materials from said storing means, and 
for displaying a reference image and 

associated information of each video material on a screen based on said video data and said 
associated data. 



2. The video material selecting apparatus according to Claim 1 , wherein 

said display means displays a dynamic image as said reference image of said each video material 
which satisfies said inputted requirements. 

3. The video material selecting ap paratus according to Claim 1, wherein 

while said image display means displays a static image as said reference image of said each video 
material which satisfies said inputted 

requirements, it displays said dynamic image as said reference image of s aid video material 
designated out of said video materials. 

4. The video material selecting apparatus according to Claim 3, wherein 

said dynamic image is obtained by extracting slit images from a series of frame images based on said 
video data while sequentially moving the 

positions of said slit images toward one direction and then, by sequentially displaying static images for 
a plurality of frames which are formed by 

sequentially arranging the extracted slit images of each frame image in t he other direction, for a cycle 
of prescribed frames. 

5. The video material selecting apparatus according to Claim 1, wherein 

said display means enlarges and displays said reference image of said video material designated out 
of the video materia Is of which said reference 

image and said associated information are displayed. 

6. A method of selecting a video material to select a desired video material out of a plurality of video 
materials, comprising the steps of: 
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a first step of searching said video materials which satisfy prescribed requirements out of said plurality 
of video materials; and 

a second step of displaying reference image and associated information of each of said video 
materials based on video data and associated d ata of 
each of said video materials on a screen. 



7. The method of selecting a video material according to Claim 6, wherein 

in said second step, a dynamic image is displayed as said reference image of each video material 
which satisfies said requirements. 

8. The method of selecting a video material according to Claim 6, wherein 

in said second step, while a static image is displayed as said reference image of said each video 
material which satisfies said requirements, a 

dynamic image is displayed as sard reference image with respect to said video material designated 
out of said video materials. 

9. The method of selecting a video material according to Claim 8, wherein 

said dynamic image is obtained by extracting slit image s from a series of frame images based on said 
video data while sequentially moving the 

positions of said slit images toward one direction and then, by sequentially displaying static images for 
a plurality of frames, which are formed by 

sequentially arranging said extracted slit images of each frame image in the other direction, for a cycle 
of prescribed frames. 

10. The method of selecting a video materia! according to Claim 6, wherein 

in said second step, said reference image is enlarged a nd displayed with respect to said video 
material designated out of the video materials of 

which said reference images and said associated information are displayed. 
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